Effects of face masks on language comprehension in bilingual children.

Due to the COVID-19 pandemic, many children receive language input through face coverings. The impact of face coverings for children's abilities to understand language remains unclear. Past research with monolingual children suggests that hearing words through surgical masks does not disrupt word recognition, but hearing words through transparent face shields proves more challenging. In this study, we investigated effects of different face coverings (surgical masks and transparent face shields) on language comprehension in bilingual children. Three-year-old English-Mandarin bilingual children (N = 28) heard familiar words in both English and Mandarin spoken through transparent face shields, surgical masks, and without masks. When tested in English, children recognized words presented without a mask and through a surgical mask, but did not recognize words presented with transparent face shields, replicating past findings with monolingual children. In contrast, when tested in Mandarin, children recognized words presented without a mask, through a surgical mask, and through a transparent face shield. Results are discussed in terms of specific properties of English and Mandarin that may elicit different effects for transparent face shields. Overall, the present findings suggest that face coverings, and in particular, surgical masks do not disrupt spoken word recognition in young bilingual children.

The effects of face mask on speech production and its implication for forensic speaker identification-A cross-linguistic study.

This study aims to understand the effects of face mask on speech production between Mandarin Chinese and English, and on the automatic classification of mask/no mask speech and individual speakers. A cross-linguistic study on mask speech between Mandarin Chinese and English was then conducted. Continuous speech of the phonetically balanced texts in both Chinese and English versions were recorded from thirty native speakers of Mandarin Chinese (i.e., 15 males and 15 females) with and without wearing a surgical mask. The results of acoustic analyses showed that mask speech exhibited higher F0, intensity, HNR, and lower jitter and shimmer than no mask speech for Mandarin Chinese, whereas higher HNR and lower jitter and shimmer were observed for English mask speech. The results of classification analyses showed that, based on the four supervised learning algorithms (i.e., Linear Discriminant Analysis, Naïve Bayes Classifier, Random Forest, and Support Vector Machine), undesirable performances (i.e., lower than 50%) in classifying the speech with and without a face mask, and highly-variable accuracies (i.e., ranging from 40% to 89.2%) in identifying individual speakers were achieved. These findings imply that the speakers tend to conduct acoustic adjustments to improve their speech intelligibility when wearing surgical mask. However, a cross-linguistic difference in speech strategies to compensate for intelligibility was observed that Mandarin speech was produced with higher F0, intensity, and HNR, while English was produced with higher HNR. Besides, the highly-variable accuracies of speaker identification might suggest that surgical mask would impact the general performance of the accuracy of automatic speaker recognition. In general, therefore, it seems wearing a surgical mask would impact both acoustic-phonetic and automatic speaker recognition approaches to some extent, thus suggesting particular cautions in the real-case practice of forensic speaker identification.

Introduction to the Special Issue on COVID-19.

The COVID-19 pandemic has been a global event affecting all aspects of human life and society, including acoustic aspects. In this Special Issue on COVID-19 and acoustics, we present 48 papers discussing the acoustical impacts of the pandemic and how we deal with it. The papers are divided into seven categories which include: physical masking and speech production, speech perception, noise, the underwater soundscape, the urban soundscape, pathogen transmissibility, and medical diagnosis.

Effects of Age at Implantation on Outcomes of Cochlear Implantation in Children with Short Durations of Single-Sided Deafness.

OBJECTIVE: Children with single-sided deafness (SSD) show reduced language and academic development and report hearing challenges. We aim to improve outcomes in children with SSD by providing bilateral hearing through cochlear implantation of the deaf ear with minimal delay. STUDY DESIGN: Prospective cohort study of 57 children with SSD provided with cochlear implant (CI) between May 13, 2013, and June 25, 2021. SETTING: Tertiary children's hospital. PARTICIPANTS: Children with early onset (n = 40) or later onset of SSD (n = 17) received CIs at ages 2.47 ± 1.58 years (early onset group) and 11.67 ± 3.91 years (late onset group) (mean ± SD). Duration of unilateral deafness was limited (mean ± SD = 1.93 ± 1.56 yr). INTERVENTION: Cochlear implantation of the deaf ear. MAIN OUTCOMES/MEASURES: Evaluations of device use (data logging) and hearing (speech perception, effects of spatial release from masking on speech detection, localization of stationary and moving sound, self-reported hearing questionnaires). RESULTS: Results indicated that daily device use is variable (mean ± SD = 5.60 ± 2.97, range = 0.0-14.7 h/d) with particular challenges during extended COVID-19 lockdowns, including school closures (daily use reduced by mean 1.73 h). Speech perception with the CI alone improved (mean ± SD = 65.7 ± 26.4 RAU) but, in the late onset group, remained poorer than in the normal hearing ear. Measures of spatial release from masking also showed asymmetric hearing in the late onset group ( t13 = 5.14, p = 0.001). Localization of both stationary and moving sound was poor (mean ± SD error = 34.6° ± 16.7°) but slightly improved on the deaf side with CI use ( F1,36 = 3.95, p = 0.05). Decreased sound localization significantly correlated with poorer self-reported hearing. CONCLUSIONS AND RELEVANCE: Benefits of CI in children with limited durations of SSD may be more restricted for older children/adolescents. Spatial hearing challenges remain. Efforts to increase CI acceptance and consistent use are needed.

Listening Effort and Speech Perception Performance Using Different Facemasks.

PURPOSE: The aim of this study was to assess the effect of eight different facemasks on speech perception and listening effort in listeners with normal hearing (NH) and hearing loss by manipulating both mask type and background noise levels. METHOD: Forty adults listened to Quick Speech-in-Noise Test sentences recorded by a female talker through eight different facemasks including a baseline condition with no mask. Listeners were tested in the sound field positioned 6 ft from the loudspeaker. Signal-to-noise ratio (SNR) loss and listening effort were measured. RESULTS: Listeners with NH exhibited a mild SNR loss, whereas those with hearing loss experienced a moderate SNR loss. Scores for the mild hearing loss group were significantly poorer (higher) than those with slight hearing loss. Speech perception performance was best in the no mask, KN95, and surgical mask conditions and poorest in the cloth mask and cloth mask plus face shield conditions for all groups. As listening effort decreased, speech perception increased for all groups. CONCLUSIONS: The impact of different types of facemasks on speech perception in noise was demonstrated in this study indicating that as the SNR was reduced, listening effort increased and speech perception performance decreased for listeners with NH and slight/mild hearing loss. No mask, KN95, and surgical masks had the least impact on performance, whereas cloth masks posed a significant detriment to communication. If communication is to occur in a background of noise while wearing masks, a KN95 mask and an SNR of at least +15 dB is recommended regardless of hearing status.

Challenging Times for Cochlear Implant Users - Effect of Face Masks on Audiovisual Speech Understanding during the COVID-19 Pandemic.

Unhindered auditory and visual signals are essential for a sufficient speech understanding of cochlear implant (CI) users. Face masks are an important hygiene measurement against the COVID-19 virus but disrupt these signals. This study determinates the extent and the mechanisms of speech intelligibility alteration in CI users caused by different face masks. The audiovisual German matrix sentence test was used to determine speech reception thresholds (SRT) in noise in different conditions (audiovisual, audio-only, speechreading and masked audiovisual using two different face masks). Thirty-seven CI users and ten normal-hearing listeners (NH) were included. CI users showed a reduction in speech reception threshold of 5.0 dB due to surgical mask and 6.5 dB due to FFP2 mask compared to the audiovisual condition without mask. The greater proportion of reduction in SRT by mask could be accounted for by the loss of the visual signal (up to 4.5 dB). The effect of each mask was significantly larger in CI users who exclusively hear with their CI (surgical: 7.8 dB, p = 0.005 and FFP2: 8.7 dB, p = 0.01) compared to NH (surgical: 3.8 dB and FFP2: 5.1 dB). This study confirms that CI users who exclusively rely on their CI for hearing are particularly susceptible. Therefore, visual signals should be made accessible for communication whenever possible, especially when communicating with CI users.

COVID-19 era: Hearing handicaps behind face mask use in hearing aid users.

BACKGROUND: The aim of this study was to assess the effect on speech perception and lack of hearing devices gain with surgical masks worn in hearing aid users. METHODS: This prospective cohort study enrolled consecutive patients between November 2020 and February 2021 in a tertiary care medical center from Spain. Fifty-five subjects have been included, 10 as control group, with normal hearing, and 45 patients with sensory-neural hearing loss and hearing aid users, ranging in age between 31 and 83 years old, and were recruited randomized in 4 months. Appropriate test was done previously to check adequate functioning from devices and suitable adaptation. Control group had no hearing impairment neither otologic disease. RESULTS: Disyllabic test in quiet get worse with face mask with a significant difference and stronger impact in noisy background. Age made no difference. Adding lipreading speech perception improved by 95.1 % for younger subjects (<50 years of age) and 91.2% for older subjects (>50 years of age). In the control sample, there was no differences in any condition. CONCLUSION: Despite advantages of wearing mask in preventing coronavirus disease 2019 spread, we must consider that they have also drawbacks for some groups like hearing aid users. In this research, we have not observed high frequencies perception decrease with surgical masks worn, but there was reduction in speech perception, most notably in hearing aids wearers in noisy environment.

Would you respect a norm if it sounds foreign? Foreign-accented speech affects decision-making processes.

Does listening to a foreign-accented speaker bias native speakers' behavior? We investigated whether the accent, i.e., a foreign accent versus a native accent, in which a social norm is presented affects native speakers' decision to respect the norm (Experiments 1 and 2) and the judgement for not respecting it (Experiment 2). In Experiment 1, we presented 128 native Spanish speakers with new social norms, adapted from the measures imposed by the Spanish Government to fight the Covid-19 pandemic (e.g., 'To avoid the spread of the Covid-19 virus, keep your distance'), whereas in Experiment 2, we presented 240 native Spanish speakers with everyday social norms learned from childhood (e.g., 'Not littering on the street or in public places'), that have an intrinsic cultural and linguistic link. In Experiment 1, the norms were uttered either in a native accent, or in a foreign accent unfamiliar to our participants to avoid stereotypes. In Experiment 2, we added an accent negatively perceived in Spain to assess the role of language attitudes on decision making. Overall, accent did not directly impact participants' final decisions, but it influenced the decision-making process. The factors that seem to underlie this effect are emotionality and language attitudes. These findings add up to the recent Foreign Accent effect observed on moral judgements and further highlight the role of the speaker's identity in decision making.

Speech Recognition and Listening Effort of Meaningful Sentences Using Synthetic Speech.

Speech-recognition tests are an important component of audiology. However, the development of such tests can be time consuming. The aim of this study was to investigate whether a Text-To-Speech (TTS) system can reduce the cost of development, and whether comparable results can be achieved in terms of speech recognition and listening effort. For this, the everyday sentences of the German Göttingen sentence test were synthesized for both a female and a male speaker using a TTS system. In a preliminary study, this system was rated as good, but worse than the natural reference. Due to the Covid-19 pandemic, the measurements took place online. Each set of speech material was presented at three fixed signal-to-noise ratios. The participants' responses were recorded and analyzed offline. Compared to the natural speech, the adjusted psychometric functions for the synthetic speech, independent of the speaker, resulted in an improvement of the speech-recognition threshold (SRT) by approximately 1.2 dB. The slopes, which were independent of the speaker, were about 15 percentage points per dB. The time periods between the end of the stimulus presentation and the beginning of the verbal response (verbal response time) were comparable for all speakers, suggesting no difference in listening effort. The SRT values obtained in the online measurement for the natural speech were comparable to published data. In summary, the time and effort for the development of speech-recognition tests may be significantly reduced by using a TTS system. This finding provides the opportunity to develop new speech tests with a large amount of speech material.

Chilean spanish transcultural adaptation of CAP-II and SIR scales in an online format for parents of children with hearing aids or cochlear implants / Adaptación transcultural al español chileno de las escalas CAP-II y SIR en formato online para padres de niños(as) con audífonos o implantes cocleares

La adquisición de lengua oral representa un desafío para niñas/os sordas/os o con pérdida auditiva (NSPA) que utilizan audífonos o implante coclear (CI). Tomar decisiones a tiempo durante el tratamiento con dispositivos es esencial y requiere de evaluaciones adecuadas. Dos instrumentos usados en la toma de decisiones son las escalas "Categories of Auditory Performance Index II" (CAP-II) y "Speech Intelligibility Rating Scale" (SIR). Estas escalas han mostrado ser útiles para la evaluación continua del desarrollo de habilidades auditivas y de la lengua oral en variados idiomas, pero estas no están disponibles para el español chileno. El objetivo de este estudio es crear traducciones en español chileno de las escalas CAP-II y SIR, las que puedan ser usadas como auto-reporte online por padres y cuidadores con el fin de asistir a profesionales en el monitoreo del progreso de niños/as NSPA, considerando las restricciones impuestas por el COVID-19. El método usado en el proceso comienza con la traducción de una propuesta de auto-reporte de las versiones originales en inglés de las escalas CAP-II y SIR. Finalmente, las versiones en español chileno fueron testeadas en 107 padres-cuidadores de niñas/os NSPA con CI. Los resultados sugieren que estos instrumentos serían adecuados para su uso en el contexto chileno.

Spoken language acquisition is challenging for very young deaf or hard-of-hearing children (DHH) who wear hearing aids or cochlear implants (CI). Timely decision-making for treatment is essential for these children and requires suitable assessments. Two such assessments are the Categories of Auditory Performance Index II (CAP-II) and the Speech Intelligibility Rating Scale (SIR). These have been shown to be helpful for the ongoing evaluation of developing speech perception and spoken language skills in various languages, but they are not available in Chilean Spanish. This study aimed to create a Chilean Spanish translation of the CAP-II and SIR, appropriate for online self-administration by parents-caregivers in Chile, to assist professionals in monitoring DHH children's progress, considering the COVID-19 restrictions. The methods used in the process started with translating a self-report proposal from the original English versions of the CAP-II and SIR scales. Finally, the Chilean Spanish versions were tested in 107 Chilean parents-caregivers of DHH children with CIs. The results suggest these instruments are suitable for use in a Chilean context.

Lasting effects of the COVID-19 pandemic on language processing.

A central question in understanding human language is how people store, access, and comprehend words. The ongoing COVID-19 pandemic presented a natural experiment to investigate whether language comprehension can be changed in a lasting way by external experiences. We leveraged the sudden increase in the frequency of certain words (mask, isolation, lockdown) to investigate the effects of rapid contextual changes on word comprehension, measured over 10 months within the first year of the pandemic. Using the phonemic restoration paradigm, in which listeners are presented with ambiguous auditory input and report which word they hear, we conducted four online experiments with adult participants across the United States (combined N = 899). We find that the pandemic has reshaped language processing for the long term, changing how listeners process speech and what they expect from ambiguous input. These results show that abrupt changes in linguistic exposure can cause enduring changes to the language system.

Effects of experience on recognition of speech produced with a face mask.

Over the past two years, face masks have been a critical tool for preventing the spread of COVID-19. While previous studies have examined the effects of masks on speech recognition, much of this work was conducted early in the pandemic. Given that human listeners are able to adapt to a wide variety of novel contexts in speech perception, an open question concerns the extent to which listeners have adapted to masked speech during the pandemic. In order to evaluate this, we replicated Toscano and Toscano (PLOS ONE 16(2):e0246842, 2021), looking at the effects of several types of face masks on speech recognition in different levels of multi-talker babble noise. We also examined the effects of listeners' self-reported frequency of encounters with masked speech and the effects of the implementation of public mask mandates on speech recognition. Overall, we found that listeners' performance in the current experiment (with data collected in 2021) was similar to that of listeners in Toscano and Toscano (with data collected in 2020) and that performance did not differ based on mask experience. These findings suggest that listeners may have already adapted to masked speech by the time data were collected in 2020, are unable to adapt to masked speech, require additional context to be able to adapt, or that talkers also changed their productions over time. Implications for theories of perceptual learning in speech are discussed.

Study of optical-based speech acquisition system using vibration signals from speakers' medical masks.

Medical masks have become necessary of late because of the COVID-19 outbreak; however, they tend to attenuate the energy of speech signals and affect speech quality. Therefore, this study proposes an optical-based microphone approach to obtain speech signals from speakers' medical masks. Experimental results showed that the optical-based microphone approach achieved better performance (85.61%) than the two baseline approaches, namely, omnidirectional (24.17%) and directional microphones (31.65%), in the case of long-distance speech and background noise. The results suggest that the optical-based microphone method is a promising approach for acquiring speech from a medical mask.

COVID-19 and Deafness: Impact of Face Masks on Speech Perception.

BACKGROUND: The COVID-19 pandemic has made wearing face masks a common habit in public places. Several reports have underlined the increased difficulties encountered by deaf people in speech comprehension, resulting in a higher risk of social isolation and psychological distress. PURPOSE: To address the detrimental effect of different types of face masks on speech perception, according to the listener hearing level and background noise. RESEARCH DESIGN: Quasi-experimental cross-sectional study. STUDY SAMPLE: Thirty patients were assessed: 16 with normal hearing [NH], and 14 hearing-impaired [HI] with moderate hearing loss. DATA COLLECTION AND ANALYSIS: A speech perception test (TAUV) was administered by an operator trained to speak at 65 dB, without a face mask, with a surgical mask, and with a KN95/FFP2 face mask, in a quiet and in a noisy environment (cocktail party noise, 55 dB). The Hearing Handicap Index for Adults (HHI-A) was administered twice, asking subjects to complete it for the period before and after the pandemic outburst. A 2-way repeated-measure analysis of variance was performed. RESULTS: The NH group showed a significant difference between the no-mask and the KN95/FFP2-mask condition in noise (p = 0.01). The HI group showed significant differences for surgical or KN95/FFP2 mask compared with no-mask, and for KN95/FFP2 compared with surgical mask, in quiet and in noise (p < 0.001). An increase in HHI-A scores was recorded for the HI patients (p < 0.001). CONCLUSION: Face masks have a detrimental effect on speech perception especially for HI patients, potentially worsening their hearing-related quality of life.

Teaching acoustics during a pandemic: Lab in a Box for experiments at home.

In March 2020 with the advent of COVID, emergency plans were put in place to deliver the Master's Course in Environmental and Architectural Acoustics entirely on-line. This was necessary as although the acoustics laboratory is large, it was deemed to be unsafe for face-to-face teaching due to a complete lack of ventilation in the anechoic and reverberation chambers. Hence, it was necessary to create an alternative for the 2020/21 delivery. In September 2020, it was decided that a "Lab in a Box" supported by on-line demonstrations and pre-recorded films would create the best alternative experience for the postgraduate students. The "Lab in a Box" allowed demonstrations to be replicated at home or in the garden using a Windows based calibrated measurement platform based on audio components. Examples of such laboratories included Fast and Slow Measurements, Noise Exposure, Noise Survey, Loudness, Reverberation Time, and Speech Intelligibility. The results showed that the students gained from more independence and increased flexibility in delivery, achieving very similar marks. This has opened up the possibility of increasing student numbers by reusing these alternative teaching strategies in the future.

Perceived Listening Difficulties of Adult Cochlear-Implant Users Under Measures Introduced to Combat the Spread of COVID-19.

Following the outbreak of the COVID-19 pandemic, public-health measures introduced to stem the spread of the disease caused profound changes to patterns of daily-life communication. This paper presents the results of an online survey conducted to document adult cochlear-implant (CI) users' perceived listening difficulties under four communication scenarios commonly experienced during the pandemic, specifically when talking: with someone wearing a facemask, under social/physical distancing guidelines, via telephone, and via video call. Results from ninety-four respondents indicated that people considered their in-person listening experiences in some common everyday scenarios to have been significantly worsened by the introduction of mask-wearing and physical distancing. Participants reported experiencing an array of listening difficulties, including reduced speech intelligibility and increased listening effort, which resulted in many people actively avoiding certain communication scenarios at least some of the time. Participants also found listening effortful during remote communication, which became rapidly more prevalent following the outbreak of the pandemic. Potential solutions identified by participants to ease the burden of everyday listening with a CI may have applicability beyond the context of the COVID-19 pandemic. Specifically, the results emphasized the importance of visual cues, including lipreading and live speech-to-text transcriptions, to improve in-person and remote communication for people with a CI.

Harmonicity aids hearing in noise.

Hearing in noise is a core problem in audition, and a challenge for hearing-impaired listeners, yet the underlying mechanisms are poorly understood. We explored whether harmonic frequency relations, a signature property of many communication sounds, aid hearing in noise for normal hearing listeners. We measured detection thresholds in noise for tones and speech synthesized to have harmonic or inharmonic spectra. Harmonic signals were consistently easier to detect than otherwise identical inharmonic signals. Harmonicity also improved discrimination of sounds in noise. The largest benefits were observed for two-note up-down "pitch" discrimination and melodic contour discrimination, both of which could be performed equally well with harmonic and inharmonic tones in quiet, but which showed large harmonic advantages in noise. The results show that harmonicity facilitates hearing in noise, plausibly by providing a noise-robust pitch cue that aids detection and discrimination.

Masking of the mouth area impairs reconstruction of acoustic speech features and higher-level segmentational features in the presence of a distractor speaker.

Multisensory integration enables stimulus representation even when the sensory input in a single modality is weak. In the context of speech, when confronted with a degraded acoustic signal, congruent visual inputs promote comprehension. When this input is masked, speech comprehension consequently becomes more difficult. But it still remains inconclusive which levels of speech processing are affected under which circumstances by occluding the mouth area. To answer this question, we conducted an audiovisual (AV) multi-speaker experiment using naturalistic speech. In half of the trials, the target speaker wore a (surgical) face mask, while we measured the brain activity of normal hearing participants via magnetoencephalography (MEG). We additionally added a distractor speaker in half of the trials in order to create an ecologically difficult listening situation. A decoding model on the clear AV speech was trained and used to reconstruct crucial speech features in each condition. We found significant main effects of face masks on the reconstruction of acoustic features, such as the speech envelope and spectral speech features (i.e. pitch and formant frequencies), while reconstruction of higher level features of speech segmentation (phoneme and word onsets) were especially impaired through masks in difficult listening situations. As we used surgical face masks in our study, which only show mild effects on speech acoustics, we interpret our findings as the result of the missing visual input. Our findings extend previous behavioural results, by demonstrating the complex contextual effects of occluding relevant visual information on speech processing.

Effects of word familiarity and receptive vocabulary size on speech-in-noise recognition among young adults with normal hearing.

Having a large receptive vocabulary benefits speech-in-noise recognition for young children, though this is not always the case for older children or adults. These observations could indicate that effects of receptive vocabulary size on speech-in-noise recognition differ depending on familiarity of the target words, with effects observed only for more recently acquired and less frequent words. Two experiments were conducted to evaluate effects of vocabulary size on open-set speech-in-noise recognition for adults with normal hearing. Targets were words acquired at 4, 9, 12 and 15 years of age, and they were presented at signal-to-noise ratios (SNRs) of -5 and -7 dB. Percent correct scores tended to fall with increasing age of acquisition (AoA), with the caveat that performance at -7 dB SNR was better for words acquired at 9 years of age than earlier- or later-acquired words. Similar results were obtained whether the AoA of the target words was blocked or mixed across trials. Differences in word duration appear to account for nonmonotonic effects of AoA. For all conditions, a positive correlation was observed between recognition and vocabulary size irrespective of target word AoA, indicating that effects of vocabulary size are not limited to recently acquired words. This dataset does not support differential assessment of AoA, lexical frequency, and other stimulus features known to affect lexical access.

The COVID-19 pandemic and upgrades of CI speech processors for children: part II-hearing outcomes.

PURPOSE: To gauge the benefits to children of upgrading speech processors during the COVID-19 pandemic. METHODS: The study involved 297 children, aged from 7.3 to 18.0 years, whose processors were upgraded to either Nucleus 7 or Kanso 2, or to Sonnet 2 or Rondo 3. To document the benefits of the upgrades, a speech-in-noise discrimination test and Patient Reported Outcome Measures (PROMs) were used. RESULTS: There was a significant benefit from the newer processors in terms of speech discrimination in noise. Patient Reported Outcome Measures (PROMs) indicated less hearing disability, a higher level of functioning in everyday life situations, and more satisfaction with the new speech processor in social situations. CONCLUSION: There is a measurable improvement in performance when the devices are upgraded to the new technology.